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Abstract 

This paper provides synchronization conditions for networks of nonlinear systems. The 
components of the network (referred to as "compartments" in this paper) are made up of 
an identical interconnection of subsystems, each represented as an operator in an extended 
Li space and referred to as a "species". The compartments are, in turn, coupled through 
a diffusion-like term among the respective species. The synchronization conditions are pro- 
vided by combining the input-output properties of the subsystems with information about 
the structure of network. The paper also explores results for state-space models, as well as 
biochemical applications. The work is motivated by cellular networks where signaling occurs 
both internally, through interactions of species, and externally, through intercellular signal- 
ing. The theory is illustrated providing synchronization conditions for networks of Goodwin 
oscillators. 

1 Introduction 

The analysis of synchronization phenomena in networks has become an important topic in sys- 
tems and control theory, motivated by diverse applications in physics, biology, and engineering. 
Emerging results in this area show that, in addition to the individual dynamics of the com- 
ponents, the network structure plays an important role in determining conditions leading to 
synchronization [1] [2l |3j HI |5] . 

In this paper, we study synchronization in networks of nonlinear systems, by making use of 
the input-output properties of the subsystems comprising the network. Motivated by cellular 
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networks where signaling occurs both internally, through interactions of species, and externally, 
through intercellular signaling, we assume that each component of the network (referred to as a 
"compartment" in the paper) itself consists of subsystems (referred to as "species" ) represented 
as operators in the extended L2 space. The input to the operator includes the influence of 
other species within the compartment as well as a diffusion-like coupling term between identical 
species in different compartments. 

A similar input-output approach was taken in [6J [TJ E] to study stability properties of in- 
dividual compartments, rather than synchronization of compartments. These studies verify an 
appropriate passivity property [9j [10] for each species and form a "dissipativity matrix" , denoted 
here by E, that incorporates information about the passivity of the subsystems, the intercon- 
nection structure of the species, and the signs of the interconnection terms. To determine the 
stability of the network, [7J [8] check the diagonal stability of the dissipativity matrix, that is, 
the existence of a diagonal solution D > to the Lyapunov equation E T D + DE < 0, similarly 
to classical work on large-scale systems by Vidyasagar and others, see [HJ [121 [13]. 

In the special case of a cyclic interconnection structure with negative feedback, this diagonal 
stability test encompasses the classical secant criterion [T5] used frequently in mathematical 
biology. Following [6] [7J , reference jlGj investigated synchronization of cyclic feedback structures 
using an incremental variant of the passivity property. This reference assumes that only one of 
the species is subject to diffusion and modifies the secant criterion to become a synchronization 
condition. 

With respect to previous work, the main contributions of the present paper are as follows: 
i) The results are obtained by using a purely input-output approach. This approach requires 
in principle minimal knowledge of the physical laws governing the systems, and is therefore 
particularly well-suited to applications displaying high uncertainty on parameters and structure, 
such as (molecular) biological systems. Results for systems with an "internal description", i.e. 
in state space form, are derived as corollaries, ii) The individual species are only required to 
satisfy an output-feedback passivity condition, compared to the stronger output-strict passivity 
condition in |16j . iii) The interconnections among the subsystems composing each network are 
not limited to cyclic topologies, thus enlarging the class of systems for which synchronization can 
be proved, iv) The diffusive coupling can involve more than one species, v) The new formulation 
allows exogeneous signals, and studies their effect on synchronization. 

The paper is organized as follows. In Section [2] the notation used throughout the paper 
is summarized, and the model under study is introduced. In Section [3] the main results are 
presented, and the proofs can be found in Section [4] In Section [5] the operator property required 
to derive the synchronization condition is related to verifiable conditions for particular classes 
of systems described by ODE's; moreover the main results are extended to the case where the 
compartmental and the species couplings involve different variables. In Section [6] we show that 
the synchronization condition can be expressed in terms of algebraic inequalities, for particular 
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classes of interconnection structures. Finally, in Section [7j we illustrate the proposed theory, 
deriving synchronization conditions for a network of Goodwin oscillators. 

2 Preliminaries and problem statement 

We denote by L2e the extended space of signals w : [0, oo) — > M which have the property that 
each restriction wt = H[o,T] ^ s m -^2(0, T), for every T > 0. Given an element w E L<i e and 
any fixed T > 0, we write for the L2 norm of the restriction wt , and given two functions 

v, w G ^2e and any fixed T > 0, the inner product of and wt is denoted by (v,w)t- The 
same notation is used for vector functions 

Consider n identical compartments, each composed of TV subsystems that we refer to as 
species. The input-output behavior of species k in compartment j is described by 

Vk,j = H k v kJ , k = 1, . . . , N, j = 1, . . . , n, (1) 

where H k is an operator to be further specified. The interconnections among species and com- 
partments is given by: 

N n 

Vk,j = w kJ + ^2 o-k,iVi,j + ^2 aj, z (yk,z ~ Vk,j), k = l,...,N, j = 1, . . . , n, (2) 
i=i 2=1 

where the coefficients a k ,i G M, k,i = 1, 2, . . . , N, represent the interconnection between different 
species, and are identical in each compartment. These coefficients are grouped into an N x N 
matrix: 

£:=[<7jm]> k,i = 1,2,..., N, (3) 

and the resulting interconnection is called species coupling. 

The scalars z ,k = 1 , 2 . . . , N, j, z = 1,2 ... ,n are nonnegative and represent the inter- 
connection among systems of the same species in different compartments. We will call this 
interconnection compartmental coupling. We assume that there are no self-loops, i.e. a*^ = 0, 
k = 1, 2 . . . , N, j = 1,2 ... ,n. Note that different species can possess different coupling struc- 
tures (as implied by the superscript k in a^ 2 ). The compartmental coupling is expressed in a 
diffusive-like form, as a function of the differences between species in the respective compart- 
ments, and not the species themselves. This is more general than true diffusion, which would 
correspond to the special case in which aj z = • for all k,j, z; under this symmetry condition, 
the fluxes z (yk, z — Vkj) an d a* j{lJk,j ~ Uk,z) (between the kih species in the jth and the zth 
compartments) would cancel each other out. 

Finally, the scalars w kt j are external inputs that can model e.g., L<i e disturbances acting on 
the systems. The resulting interconnected system can be represented as a graph as illustrated 
in Figure [TJ 

1 We will denote by L^e the extended space of m dimensional signals. 
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Figure 1: Example of interconnection structure. Each compartment is composed by 3 subsys- 
tems (represented as nodes of a graph) each characterized by an operator H k , k = 1, 2, 3. Two 
subsystems of the same species in different compartments are connected by an edge whenever 
the corresponding coefficient ah z is positive. In each compartment, different species are inter- 
connected according to a directed graph where the output of a system characterized by the 
operator Hi enters as input of another system (characterized by an operator Hj) weighted by 
the coefficient cr-,^. In this example, the interconnections are cyclic (crjj = unless i = j + 1 
mod N), but the theory allows arbitrary graphs. The compartments composing the network are 
assumed to be identical. For simplicity, no external inputs are shown in this figure. 

We denote by Y k = [y fc ,i, • • • , yk,n] T , V k = [v k ,i, v k , n } T and W k = [w k ,i, w k)1l } T the 
vectors of the outputs, inputs and external signals of systems of the same species k, and by 
Y = col(Yi, . . . , Y N ), V = col(Vi, . . . , V N ) and W = col(Wi, . . . , W N ) the stacked vectors. We 
then rewrite the feedback law ^ as 

N 

V k {t) = W k {t) + Y J OkiY i {t)-L k Y k {t), k = l,2,...,N, (4) 

i=l 

where L k , k = 1, . . . , N are Laplacian matrices associated to the compartmental coupling: 

f n 

2 = 1 

The connectivity properties of the corresponding graphs are related to the algebraic proper- 
ties of the Laplacian matrices and, in particular, to the notion of algebraic connectivity extended 
to directed graphs in [T7] : 

Definition 1 For a directed graph with Laplacian matrix L k , the algebraic connectivity is the 
real number defined as: 

\ ■ zTLkZ / r \ 

X k = mm — =, — (5) 

26P Z 1 Z 



l k ■ 
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where V = {z G K n : z±l n , \\z\\ = 1} and where 1„ = [1,1,..., l] r G M n . 

To characterize synchronization mathematically, we denote the average of the outputs of the 
n copies of the species k by: 

% := h%Y k , (6) 
where 1„ = [1,1,..., 1] T G M n , fc = 1, 2, . . . , N, and define: 

AY" fc := col(y fc i -Y k ,..., y k , n - %)■ (7) 

Because AY k is equal to zero if and only if Y k = a k l n for some a k > 0, ||Alfc|| T measures the 
synchrony of the outputs of the species k in the time interval [0,T]. 

We recall now an operator property that will be extensively used in the paper (the definitions 
are slightly adapted versions of those in [15] . [19] and [TU]). 

Definition 2 Let H : U£ e — > L^. T/ien if is relaxed cocoercive if there exists some 7 C G M suc/t 
i/iai /or ewery pair o/ inputs u,v G 

7 c ||iJw- fru||§, < (ffu- Hv,u- v) T , VT > 0. (8) 

7/ ZioWs mi/j 7 C > ; then H is called monotone. If holds with 7 C > 0, then H is called 
cocoercive. 

Cocoercivity implies monotonicity and monotonicity implies relaxed cocoercivity. We refer to 
the maximum possible 7 C with which Q holds as the cocoercivity gain, and denote it as 7. The 
existence of 7 follows because the set of 7 c 's that satisfy ^ is closed from above. In particular, 
we will call ^-relaxed cocoercive the operators with a cocoercivity gain 7 £ 1. Notice that a 
7-relaxed cocoercive operator with a strictly positive 7 is a cocoercive operator while, in general, 
it is only relaxed-cocoercive (monotone when 7 = 0). 

When there is no coupling between the compartments, i.e. L k = 0, k = 1, 2, . . . , N, the 
compartments are isolated and their stability depends on the species coupling. Stability with 
species coupling has been studied in [6] with an input-output approach, and in [71 |5J with a 
Lyapunov approach. Using the output strict passivity property of the operators H^: 

lk\\H k u\\\ < (H k u,u) T , (9) 

and defining the dissipativity matrix^ 

S 7 = S-r, r = diag(7i,72,...,7jv), 7 = col(7i, • • ■ ,7 N ) (10) 



2 The matrix used in [7JIH] is slightly different than the one used here; we are adopting the equivalent formulation 
found in [20] , 
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where £ is the interconnection matrix ([3]), |8] prove stability of the interconnected system 
from the diagonal stability of the dissipative matrix £7 7 ; that is, from the existence of a diagonal 
matrix D > such that 

E^D + DEj < 0. (11) 

As we will see in Theorem 1 below, the dissipativity matrix plays an important role also 
when studying the synchronization properties of the system ([TJ-Q. The key differences of 
Theorem 1 from [TJ [S] is that the output strict passivity property ^ is replaced with the 
incremental property in Definition [2j and the coefficients in Ej are augmented with terms 
from Definition [T] which are due to diffusive coupling of the compartments. Because the diagonal 
stability condition is more relaxed when 7^ is augmented with > 0, the new result makes it 
possible to show synchronization of the compartments when the individual compartments fail 
the stability test of |8] and exhibit e.g. limit cycles. 



3 Main results 

The following theorem relates the properties of the interconnections and the operators to the 
synchrony of the outputs in the closed-loop system. In particular we show that, if the operators 
describing the open-loop systems are 7-relaxed cocoercive and the interconnection matrices 
satisfy certain algebraic conditions, the closed loop system has the property that external inputs 
with a "high" level of synchrony (as implied by a small || AW||t) produce outputs with the same 
property (small ||AW||r). 

Theorem 1 Consider the closed loop system defined by pp-pjp. Suppose that the following 
assumptions are verified: 

1. Each operator is ^-relaxed cocoercive as in Definition^ k = 1, 2, . . . , N. 

2. For k = 1, . . . , N, 7^ '■= \k + Ik > 0, where Xk is the algebraic connectivity in Definition 
[I] associated to the matrix that describes the compartmental coupling of species k. 



3. The dissipativity matrix Ej defined as in (10) with 7 = col (71, . . . ,7at), is diagonally 
stable. 

Then, for all w^j, yj.j, k = 1, 2, . . . , N, j = 1, 2, . . . , n that satisfy |I]) and pjp we have 

||Ay|| T </o||AW|| T , VT>0, (12) 

for some p>0, and all W G Lg n , where AW = col(AWi, . . . , AW N ),AY = col(AYi, . . . , AY N ). 
Moreover, if W G L^ n , then also AY G L^ n , and we have \\AY\ \ < p\\AW\\. □ 

Since subtracting a positive diagonal matrix from a diagonally stable matrix preserves di- 
agonal stability, Theorem 1 says that the compartmental coupling increases the co-coercivity 
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gain of a species whenever the algebraic connectivity is strictly positive. The algebraic connec- 
tivity is intimately related to topological properties of the underlying graph associated to the 
compart mental coupling (see Section 4, Remark 2). 

This result can be extended to analyze synchronization in systems described with a state 
space formalism (with arbitrary initial conditions). This extension takes the form of a Corollary 
of Theorem 1. Consider the systems 

. k = l,...,N, j = l,...,n, (13) 

where yk,j,Uk,j are scalars and Xkj £ K p and the initial conditions are arbitrary. We assume that 
/&(•, •) are locally Lipschitz in the first argument and that /tfc(-) are continuous. Furthermore we 
assume that the systems are L2-well-posed, in the sense that for each vj-j 6 Li e and each initial 
state there is a unique solution defined for all t > and the corresponding outputs Uk,j(t) are 
also in Li e . 

If we set the initial conditions to zero we can define the input-output operators '■ Li e — ► 



Lie by substituting any input v\. j G Li e in (13), solving the differential equation, and substitut- 



ing the resulting state-space trajectory in y^j = hk(xkj) in order to obtain the output function 
Vk,j- If we assume that the operators are well defined and we define the input as in Q then 
the results of Theorem 1 apply to the closed loop system. 

The assumption that the initial state of the systems are set to zero is easy to dispose of, 
assuming appropriate reachability conditions. The following Corollary of Theorem 1 states that 
under the assumptions of Theorem 1 plus reachability and detectability conditions, the solutions 
of the compartments asymptotically synchronize. In particular we will assume that the closed- 



loop system (13) is zero-state reachable, i.e. that for any state x* there exists an input belonging 



to Li that drives the system from the zero state to x* in finite time. 



Corollary 1 Consider system (IS). Assume that the nonlinear operators associated to (IS) 



with zero initial conditions are well defined, that the conditions in Theorem 1 are verified and 



that the closed loop system is zero-state reachable. Then for all the outputs that satisfy (IS) 
with inputs as in (Q) but with no external inputs (wkj = 0), we have that \/k = 1, . . . , N,Vi,j = 
1, . . . ,n, yk,i{t) — Vkjit) — ► 0, as t — > oo. In addition, if for all initial states and all inputs any 
two state trajectories satisfy 

\\yk,j ~ Vk,i\\ -> =>• \\x k ,j - Xk,i\\ -> 0, k = l,...,N, j,i=l,...,n, 

as t — > oo, then all bounded network solutions synchronize and the synchronized solution con- 
verges to the limit set of the isolated system (i.e. the system where ajt,j = for every k,j). 

□ 
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4 Proof of the main result and corollary 

We define the (n-l)xn matrix 



Q 



-1 + (n — l)v 1 — v —v 
-1 + (n — l)v —v 1 — v 

-1 + (n — l)f — f 



— v 
-v \ — V 



(14) 



where 



n — \/n 



n(n — 1) 



(15) 



It follows that Ql n = 0, QQ T = I n -i, and 



Q T Q 



n-l -1 

n n 

-1 n-l 

n n 



-1 n-l 
n n 



1 rp 

L n ^n^n • 
n 



(16) 



By observing that 



Y k := QY k 



(17) 



is equal to zero for every k = 1, . . . , n if and only if Yjt = afcl n for every A; = 1, . . . , N, for some 



atk > 0, it is evident that also 



is a measure of synchrony for the outputs of the species (in 
different compartments) denoted by the index k. Moreover, since Q T QYj t = AY^ from ^ and 
(16), Yk and AYjt are related by AY^ = Q T Yk and, thus, 



k\ \t 



YifQQ 1 Y k dt 



Y k 



, k = l,2 t ...,N. 



(18) 



In what follows we will use the same notation to measure input synchrony, i.e., we define Uk = 
QUk, Wk = QWk, Vk = QVk- Before proving Theorem 1 we present a preliminary Lemma: 

Lemma 1 Consider the open-loop systems |7p. If the operators Hk, k = 1,2 ,N are 7&- 

relaxed cocoercive then 



Ik 



Y k 



T 



<{Y k ,V k ) T , k = l 



)'''?! 



for each T > and every Vk G L^e- 
Proof: Consider the scalar product 



{Vk,Y h 



k/T 



(19) 
□ 

(20) 



and define z k ,j = v k ,j — JkVkj f° r every k, j, that in vector form reads 



Z k = Vk- 7felfc. 



(21) 
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Define Z k = QZ k . By substituting (21) in (20) we obtain 



(V k ,Y k ) T = (Z k ,Y k ) T + 7k (Y k ,Y k ) T . 



(22) 



We first claim that the term (Z k ,Y k )T is nonnegative. To show this, we use the 7&-relaxed 
cocoercivity property of H k and obtain: 

(zk,i ~ Zk,j,Uk,i ~ HkJ)T = (vk,i ~ Vkj,Uk,i ~ Vk,j)T ~ lk(yk,i ~ Vk,j,Vk,i ~ Vk,j)T > 0, (23) 



for i,j = 1,2, ... ,n. By summing (23) over i, j = 1,2, . . . ,n and by dividing by a normalization 
constant we get 



1 n 

in .4-: 



Zk,i ~ Zk,j,Vk,i ~ Vk,j)T = (Zk, Yk)r ~ n(Z k , Y k ) T > 0. 



(24) 



It follows that 

(Z k , Y k ) T = (Z k , Q T QY k ) T = (Z k , Y k - l n Y k ) T = (Z k , Y k ) T - n(Z k , Y k ) T > 0, (25) 



which proves the claim. Finally, from (22) and (25) we conclude that 



(V k , Y k ) T = {Z k , Y k ) T + lk(Y k , Y k ) T > Ik 



T 



which is the desired inequality (19). 



We are now ready to prove Theorem 1. 

Proof of Theorem 1 

Consider the inputs 

Vk{t) = Uk{t)-L k Y k {t), (26) 
where L k are the Laplacian matrices representing the coupling between the compartments and 



the U k {t) are for now thought as external inputs. From Lemma 1 and substituting (26) in (19) 
we get, 



lk 



Y k 



< (Y k ,U k ) T -(Yk,QL k Y k ) T . 



(27) 



Next, we note that I n — Q T Q = ^lnln i s a projection matrix onto the span of l n . Because 
L k l n = 0, it follows that L k (I n — Q T Q)Y k = and, thus, 



L k Y k — L k Q T QY k — L k Q T Y k . 



(28) 



By using ( 28 ) as well as the fact that 

Y k T {t)Q T QL T Q T QY{t) = Y k T \t)Q T QLQ T QY{t) 



(because this expression is a scalar), we observe that: 



(Y k ,QL k Y k ) T 



Y k T (t)Q(L k + L 1 k )Q 1 Y k (t)dt > X k I Y k (t)Y k (t)dt = X k 



Y, 



(29) 



were X k are the smallest eigenvalues of the symmetric part of the "reduced Laplacian matrices" , 
i.e., of the matrices (l/2)Q(L k + L^)Q T . By using the properties of the matrix Q it is straight- 
forward to check that is the algebraic connectivity as defined in Definition 1. Combining (27) 
and (29) we obtain 



Ik 



Yi, 



T 



< {Y k ,U k ) T -Xk 



Yi. 



T 



From Assumption 2 we have that X k > — 7& for k = 1,2, ... ,n. We conclude that 



Y h 



2 < ^(Y k ,U k ) T , 
t 7fc 



k = 1,2 



5 5 



N 



(30) 



where ^ k = 7^ + \ k . The rest of the proof follows by the same argument as that used in the 
proof of "Vidyasagar Lemma" in [20], applied to the resulting input-output system U k — > Y k 



and by using the condition ( 30 ) . Namely, we apply the feedback 

N 



U k = W k + Y J °k j Y j , k = l,2,...,N 
3=1 



(31) 



to the resulting system, where Ylf=i a kjYj represents the interconnection between the different 



species. By defining U = col(f7i, 
stacking), we rewrite (31) as 



We define 



where 



, Un) (we apply this convention in general to denote vectors 
U = W + (S <g> I n )Y. (32) 

= s — r^, 

= diag(7i, . . . ,7at). 



From Assumption 3 the matrix is diagonally stable i.e. there exist positive constants d{, i 
1 , . . . , N such that 



DE^ + E~D < 0, 



(33) 



and D = diag(di, . . . , cZjv)- Choose a > such that DE^ + E~ D < —2al]\f and observe that 



r 



{Dz,Ez i z) T = \ I z T (t)(DEy + E^D)z(t)dt<-a[ z 1 \t)z{t)dt = -a \ \z\ |* . 
2 Jo Jo 

From (30 ) we can write (d k Y k , U k — j k Y k )x > for k = 1, 2, . . . , N, and therefore 

((£> ® I n -i)Y, U-(T^® I n -i)Y) T > 0, 
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where U = col(C/i, . . .,Un) and Y = col(Yi, . . .,Y N ). Substituting U = If+(S®/ n _i)F, where 
W = col(Wi, . . . , Wn), we obtain 

({d ® i n _i)y, w + ® J n -i)y} T > o, 

and using the Cauchy-Schwartz inequality we write 



W 



Y 



> {(d ® i n )y, w) T >-((£> ® i„)y, (e* ® /„)y) T > a 



y 



for some /3 > 0. We conclude that 



y 



TF 



, VT > 0, 



for any W £ i^e" - , where p = /3/a. As a direct consequence, if W £ -k^ 71 then 



y 



< 



We conclude by observing that 



Y k 



T 



\AY k \\ T and 



T 



\AW k \\ T for every T > 0. 



To prove Corollary 1 we follow an argument similar to the one used in [20J to prove stability 
of interconnected systems. 



Proof of Corollary 1 



Consider system (13) where the initial conditions Xfcj(0) 



x 



k,j 



are arbitrary, the inputs are 



A' 



V k ,j 



Vkj) 



(34) 



i=l 



2 = 1 



for k — 1, . . . , N, j = 1, . . . , n, and let x k j be the solutions of the closed loop system. Consider 



now system (13) with initial conditions z k j(0) = and inputs v k j+w k j. From zero-reachability, 



there exist inputs w k ,j '■ [0, T] — ► E such that the solutions at time T reaches the states x° i.e. 
z k,j(T) = Xfrj for every k,j. Consider now the input 



Wk,j(t) 



w k j te[0,T] 
t > T 



(35) 



and let z k j(-) be the solution with initial state ^^-(0) = and input w k j(t) defined in (35). 
From causality we observe that z k j(T) = x k j{0) and therefore z k j(t + T) = x k j(t), t > T, and 
therefore studying the steady state behavior of z k j{-) is equivalent to studying the steady state 
behavior of x k> j(-). Consider the outputs s k j(-) associated to the solutions z k> j(-) (with zero 
initial conditions and inputs w k j)- From Theorem 1 we know that HAS"!! < p||AW||, where 
AS = col(A5i, . . . , AS N ), W = col(AWi, . . . , AW N ). Since each input w k j is in L 2 , AW is 
in and we have that AS is in L% N as well. Since the solutions z k j are bounded, from 
continuity of h k (-) we conclude that S and therefore AS is absolutely continuous (see e.g., [2T]). 
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From Barbalat's Lemma we conclude that AS — > for t — > oo that implies that also Ay — » 
for t — > oo. This proves output synchronization. State synchronization directly follows from the 
additional property that for all initial states and all inputs, given two state trajectories we have 
that 

\\ykj - Vk,i\ \ 2 => \ \x k> j - x k ,i\\ 2 -> (36) 

for k = 1, . . . , N, j, % = 1, . . . , n, as t — * oo. All the solutions that exist for all t > converge 
to the set where for every k = 1, . . . ,N, and i, j = 1, . . . , n, x k ^{t) = Xk.j(t), as f — > cxd. Since 
Lfel n = for every = 1, . . . , N, for all bounded network solutions, the synchronized solution 
converges to the limit set of the isolated system (i.e. the system where the compartments are 
uncoupled). ■ 



5 Discussion and extensions 

5.1 Conditions for relaxed cocoercivity 

The results presented require that the operators describing the input-output relation of the 
isolated systems are relaxed cocoercive. This condition must in general be checked case by 
case. Therefore, it is of interest to provide verifiable conditions, for particular classes of systems 
described by ODE's, that imply relaxed cocoercivity of the correspondent input-output operator. 
Consider a one-dimensional system of the following form: 

* = ~f(x) + u 
y = x 

with zero initial conditions. Suppose that / is a function such that for every u^ujel 

(<ri -<T 2 )(/(<ri) -/(<r 2 )) >7(<ri "^) 2 , 7£«. (38) 

We now prove that the associated input-output operator from u to y is 7-relaxed cocoercive. 
Fix the initial condition to zero. Consider two input functions u\ and 112 belonging to L2 e and 
the corresponding outputs x\ and X2 (belonging to L2 e as well). Then, 

1 d 



Since (38) holds, we conclude that 

^( X 2 - ^l) 2 < -7 (x 2 ~ Xxf + (« 2 - Ui) (x 2 ~ Xi) . 

Integrating both sides and assuming zero initial condition we finally obtain 

< x(x 2 (T) - xi(T)) 2 < -7 \\x 2 - xi\\ 2 T + (u 2 - u\,x 2 - xi) T , 
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where the norm and the inner product are taken in the L 2e spaces, showing that the associated 
input-output operator is 7-relaxed cocoercive. This result particularizes to linear time invariant 
system and e.g., for the system x = —ax + bu, y = x, we obtain 7 = a/b. 

We conclude this section by characterizing a class of memory less operators. First note that 
Definition ([2]) particularizes to the special case in which the operator H is a nonlinear function 
y = h{x) (static nonlinearity) and therefore it is possible to calculate the co-coercivity gain of a 
static nonlinearity by directly applying (|8]). 

We show now that a monotone increasing and Lipschitz continuous static nonlinearity h(-), 
with Lipschitz constant (l/£) > 0, is a ^-relaxed cocoercive operator (with positive £). From 
the Lipschitz condition we know that for every a\ , a 2 € M 

\h(p x )-h(a 2 )\<-\a x -o 2 \. (39) 
4 



Multiplying both sides of (39) by \h{a\) — h{a 2 )\ we obtain 



(h(ai) - h(a 2 )) 2 < hai - a 2 \\h(ai) - h(a 2 )\. 
Since £ > and h is monotone increasing we conclude that 

£(fc(<7i) - h(a 2 )) 2 < {ax - u 2 ){h{a x ) - h(a 2 )), 
and we conclude that h(-) is ^-relaxed cocoercive with £ > 0. 

5.2 State coupling versus output coupling 

The present work is motivated by synchronization in models of biochemical networks where the 
compartmental coupling represents the diffusion of reagent concentrations (states of the systems) 
through the compartments. The results presented in Section 1 assume that the species diffuse 
through the outputs that, in general, could be nonlinear functions of the species concentrations. 
In other words the compartmental and species couplings involve the same variables and this 
could be non realistic in the modeling of biological systems. In this section we generalize the 
results of the previous sections to handle this situation. 
Consider the system 



•Kk,j — fk(%k,j j v k,j) 

Vk,j = h k (x k j) 



k = l,...,N, j = l,...,n, (40) 



where 

N 



Vkj = w k ,j + ^2 a k,iVi,j + ^2 a jA x k,z ~ %k,j), k = l,...,N, j = 1, . . . , n, (41) 



i=i 2=1 
that corresponds, in vector notation, to 
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N 



V k (t) = W k (t) + J2a k jYj{t) - L k X k (t), 

3=1 



k = 1,2, 



,N. 



(42) 



Suppose that the solutions of (40) are defined for every input in L 2e , and that the respective 
output is in L 2e as well. We fix the initial conditions to zero and we define the nonlinear operators 



H k associated to (40). Suppose that each operator H k can be factorized as H k = T k Gk where 
Tk '■ Vkj — > Xkj is a nonlinear operator and Gk '■ Xkj — > y k ,j is a static nonlinearity associated 
to the functions hk(-) from the real line to itself. 

Suppose that the operators Hk and Gk are 7^-relaxed cocoercive and ^-relaxed cocoercive 
respectively. Consider now the closed loop system. We follow the same lines of the proof of 
Theorem 1 exploiting the cocoercivity of the functions hk(-) (associated to the operator Gk)- 
Consider the inputs 

V k (t) = U k (t)-L k X k (t), (43) 

where U k {t) are (for now) external inputs. Since H k are 7^-relaxed cocoercive, from Lemma 1, 
we get 



Ik 

Next we observe that 



< {Y k , U k ) T ~ (Y k , QL k X k ) T , k = 1,2, . . . ,N. 



(Yk, QLkXk)r 



Y k r (t)QL k Q T Xk(t)dt. 



(44) 



(45) 



Let's fix k and define s = hk(cr) and z(s) = a — ^k s - We observe that z(s) is monotone increasing, 
in fact for every S\,S2 € M 

(si - s 2 )(zi - z 2 ) = (si - s 2 ) (<J\ -a 2 - ik(s\ - s 2 )) > 0, 

where the last inequality follows from the fact that hk(-) is ^-relaxed cocoercive. By defining 
Zk{Yk) = co\(z k (y k: i), z k (yk,n)), we use the identity X k = £ k Y k + Z k to rewrite Q as 

cT 



2 



Y k T (t)Q(L k + L 1 k )Q 1 Y k (t)dt+ I Y k T Q T QLkQ T QZk(Yk)dt. 



- T 



Suppose that V n L k = then Y k 2 Q 1 QL k Q QZ k (Y k ) = Y+ L k Z k (Y k ). Since L k are doubly 
hyperdominant and z k (-) are monotone increasing functions, from Theorem 3.7 in [18] we obtain 

i-T 

Y k T L k Z k dt > 0. 



We conclude that 



{Y k , QL k X k ) T > CfcA fc / Y k T {t)Y k (t)dt = ik\k 



Y k 



(46) 



Combining (44) and (46) we obtain 

7A: Y k 



< (Yk, Uk)r — CfcAfc 



Y k 
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Therefore, if £,k^k > — 7fc for k = 1, 2, . . . , n, we conclude that 



2 <^(Y k ,U k ) T , k = l,2,...,N, (47) 
T 7fc 



where % = Ik + Ck^k- 

The rest of the the derivation follows the same lines of the proof of Theorem 1 where 7^ 
Afc + 7fc are redefined by 7k = lk + Ck^k- This leads to the following result. 



Theorem 2 Consider the closed loop system defined by (40) and (42) with zero initial con- 
ditions. Assume that the input-output operators Hj, j = 1,2, ... ,N associated to (40) are 
well-defined and suppose that the following assumptions are verified: 

1. The operators H k and the functions h k {-) are, respectively, 7 k -relaxed cocoercive and 
relaxed cocoercive respectively for k = 1, 2, . . . , N. 

2. The Laplacian matrices satisfy the condition l^L k = and for k = 1, ...,N, 7^ = 
Ik + ik^k, where \ k is the algebraic connectivity associated to the compartmental coupling. 

3. The matrix E^, where 7 = co1(tl, . . . ,7at), is diagonally stable. 
Then, 

||AF|| r < /i||AW|| T , VT>0, 

for some fi > and W & L^J 1 . Moreover, ifW£ L^™, we have ||AY|| < //HAV^H- 

Furthermore, if the closed loop systems are zero-reachable, the closed loop system (40) and 



(42) with no external inputs (W = 0) and arbitrary initial conditions has the property that the 
outputs of the compartments synchronize, i.e. Vfc = 1, . . . ,N,\/i,j = 1, . . . ,n, yk,i(t) = y k j(t), 
as t — > 00. In addition, if for all initial states and all inputs any two state trajectories satisfy 

\\yk,j - yk,i\\ -»• =^ \\xkj - x k ,i\\ -> 0, k = l,...,N, j,i=l,...,n, 

as t — > 00, then all bounded network solutions synchronize and the synchronized solution con- 
verges to the limit set of the isolated system (i.e. the system where a k j = for every k,j). 
□ 

Remark 1 The algebraic connectivity and the properties of the Laplacian matrices can be related 
to properties of the underlying interconnection graph associated to the compartmental coupling. 
The condition l T L k = required by Theorem 2 is equivalent to assuming that the underlying 
graphs are balanced (i.e. that for each vertex the sum of the weights of the edges entering in one 
vertex is equal to the sum of the weights of the edges exiting from the same vertex). Furthermore, 
since the resulting Laplacian matrices are doubly hyperdominant with zero excess the condition 
implies that L k -\-L^ are positive semidefinite and therefore the algebraic connectivity X k > 0. If 
furthermore we assume that the graph is connected, then the algebraic connectivity is guaranteed 
to be strictly positive (see e.g., \FTj ). 
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Figure 2: Cyclic interconnection structure. 



Remark 2 The results presented in the paper can be used to analyze and design nonlinear ob- 
servers. To see this, consider two identical compartments interconnected through a unidirectional 
compartmental coupling (for convention going from compartment two to compartment one). The 
interconnection can involve one or more of the species. By interpreting the diffusive coupling 
terms as output injection, we can regard the first compartment as a nonlinear model and the 
second one as its state-observer. Thus Corollary^can be used to provide provable conditions for 
the observer error to converge to zero. The fact that our formulation allows for directed (non 
symmetric) graphs is here fundamental. In Section^ we will illustrate this idea with a specific 
example. 



6 Special structures and synchronization conditions 

Our results are based on the condition that Ej be diagonally stable, which is related to both the 
compartmental coupling (through the algebraic connectivity) and the species coupling (through 
the interconnection matrix S). In this Section, we analyze a number of interconnection structures 
and provide conditions for the matrix to be diagonally stable. These conditions take the 
form of inequalities that link the algebraic connectivities of the compartmental coupling with 
the relaxed cocoercivity gains of the operators H^. 



Cyclic systems 

Stability of isolated cyclic systems is analyzed in [7j. Extending the work in (7], the output 
synchronization problem for cyclic systems was studied in |16| . for the special case in which the 
interconnected systems are coupled through the output of the first system only. Our approach is 
suitable for more general coupling (the interconnection structure is depicted in Figure pq). The 



16 



interconnection matrix is 



J cyclic 



and the dissipativity matrix is therefore 



•■■ 

1 
1 



1 



Ex. 



-7l 










-1 


1 


-72 













1 


-73 















1 


~1N 



< sec{7r/N) N . 



For this matrix to be diagonally stable the following secant condition must be satisfied [7]: 

1 1 1 

71 72 In 

Since jk = 7fc + > 0) t ne secant condition leads to: 

N 



TT ^— < sec{Tr/N) N . 



(48) 



Our approach generalizes the result of [16] (note that 7^ correspond to 1/7^ in [16]) where 
the coupling among the systems is limited to the first system (i.e., when A,- = 0, j = 2, . . . , N 
in (48)). In fact, in this case (48) reduces to 



cos(ir/N) N 

Ai > 71, 

72 • • • In 



(49) 



which is the expression provided in |16| . 

As an example, consider the case where each species in a compartment is directly connected 
to the respective species in each other compartment with the same weight q, i.e. afj = q for 
every i,j = 1, . . . , <n and k = 1, . . . N. This implies that the Laplacian matrices are 



1 



qn[I n -~l n ll), k=l,2,...,N, 



and that A& = qn, k = 1, . . . , N. In this case, (48) specializes to: 

N 



TT < sec(vr/iV) 



N 
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Figure 3: Branched interconnection structure, for notational simplicity the inputs Wjk are not 
shown in the picture. 

where, since + jk must be strictly positive, the condition q > —"fk/n, k = 1, 2, . . . , N must 



be satisfied. If we restrict the compartmental coupling to only the first species, (49) takes the 
simple form 

cos{ir/N) N 



qn > 



72 • • • 7jv 



71- 



Branched structures 



In [S] several interconnection structures have been analyzed and diagonal stability is proven for 
the associated dissipative matrices. 



i) For the interconnection structure depicted in Figure [3] the interconnection and dissipativity 
matrices are, respectively, 





1 
1 

1 

1 





-10 









1 
1 



-1 










18 




Figure 4: Second type of branched interconnection structure. For notational simplicity the 
inputs Wjk are not shown in the picture. 



E, 



hi 



-71 








-1 








-1 


1 


-72 




















1 


-73 




















1 


-74 











1 











-75 




















1 


-76 




















1 


-77 



Lemma 2 in [20] shows that E^ is diagonally stable iff the condition: 

1 1 1 < sec(7r/4) 4 

71727374 71757677 

holds. Since jk = Ik + the synchronization condition becomes: 

4 ., 7 



1 



7i + M 



n 

vfc=2 



1 



7fc + Ajs 



k=5 



1 



7fc + A fc 



< sec(7r/4) . 



If we limit the coupling to the first species only, (50) reduces to: 



(50) 



> ^ 727374 + 757677 , ,,vt 

Ai > cos(7r/4j —71. 

727374757677 

ii) For the interconnection structure depicted in Figure |4j the interconnection matrix is: 

10' 
10-100 
S b2 = 1 1 
10 1 
1 



(51) 
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and therefore the dissipativity matrix is: 



Ef 



The analysis in [8] gives the sufficient condition 

1 1 

+ 



-7i 








1 





1 


-72 


-1 











1 


-73 





1 





1 





-74 


1 











1 


-75 



which leads to 



1 



717274 
1 



7475 



< 1, 



+ 



1 



74 + A 4 \(7i + Ai)(72 + A 2 ) 75 + A 5 

to: 



< 1. 



If we limit the coupling to the first species only, (52) reduces 

Al > 7 ~ - 71- 



(52) 



(53) 



72(7475 - 1) 

7 Synchronization in networks of Goodwin oscillators 

We illustrate the proposed theory via a genetic regulatory network example: the Goodwin 
oscillator. We consider a network of n identical Goodwin oscillators interconnected through 
a compartmental coupling described by Laplacian matrices L k , k = 1,2, ... ,N. The Goodwin 
model is an example of cyclic feedback systems described in Section [6] where metabolites repress 
the enzymes which are essential for their own synthesis by inhibiting the transcription of the 
molecule DNA to messenger RNA (mRNA). The model for such a mechanism is schematically 
shown in Figure[5}a and can be described as the cyclic interconnection of 3 elementary subsystems 
plus a static nonlinearity (see Figure [5}b) . 

Each Goodwin oscillator can be modeled as a compartment made up of the following four 
cyclically interconnected sub-systems (see |22 j for more details): 



Sk, 




-h x k j + c k (v k)j + w k;j ) 



2/4, 



*§J + 1 



J 



1,2, 



1,2, 



k = 1,2,3, 



(54) 



,n, 



where b k , c k are positive coefficients, p > 1 is the Hill coefficient (that measures the cooper- 
ativity of the end product repression) and w k j are external inputs. The interconnections are 
encompassed by the inputs 



v k . 



+ ^2 a j,z ( x k,z ~ x k)j ) , k = l,...,N, j = l,...,n, 



(55) 



z=l 
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(a) 

DNA ► mRNA(m) »- Enzyme (e) 

Repression 



Substrate 



Product (p) 




Gj (Goodwin Oscillator j) 



Figure 5: (a) Biological interpretation for the Goodwin oscillator. The enzyme (e) combines with 
the substrate to produce a product (p) which represses the transcription of DNA to mRNA (m), 
the template for making the enzyme, (b) Input-output scheme representing the mathematical 
model d54j) where uij = -y^j, U2,j = Ui,j, U3,j = U2,j- 



where u\ 



-i/3 j, U2.j = Ui,j, U3.j = U2,j) and give rise to the cyclic interconnection matrix 

-1 





1 
1 
1 



while the second term in (55) represents the diffusion among the compartments. 



From Section [5] we observe that the linear sub-systems Skj,k = 1,2,3 can be associated 

to cocoercive operators with constants 7^ = b^/ck- The static nonlinearities S^j are monotone 

d ( 1 



increasing functions that satisfy 



74 



da 



a'P + 1 



< I/74, where 



' "'(Si) 



v 



+ 1 (p+1) 



Pip- 1) 



p > 1. 



(56) 



From Section [5] we know that the co-coercivity coefficient for the static nonlinearity is 74. Since 
all the blocks are associated to cocoercive operators, Assumption 1 in Theorem 1 is satisfied. 
The closed loop system is zero-state reachable since it can be fully actuated from the external 
inputs Wfrj. Furthermore it is proved in (16] that the positive orthant is an invariant set and that 
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the solutions of the closed loop system are bounded. The secant condition for cyclic systems 
(48) specifies to 



(71 + Ai) (72 + A 2 ) (73 + A 3 ) > c, 



1 



74 sec(7r/4) 



4 ' 



(57) 



Therefore, if (57) holds, then all the conditions of Corollary 1 are satisfied and we conclude 
that the concentrations of the species in different compartments synchronize when Wkj = 0, k = 
1,2,3, j = l,2,...,n. 

When the compartments are isolated each of them has a unique equilibrium. By choosing 
the parameters = = 1, k = 2, 3 and b\ = 0.5, ci = 1 it can be easily proved that the 
equilibria are asymptotically stable when p < 16. When p = 16 the steady state undergoes Hopf 
bifurcation and for p = 17 a stable limit cycle arises. With this choice, the cocoercive gains 
are 72 = 73 = l,7i = 0.5. By substituting p = 17 in (56) we obtain 74 = 0.23 and the secant 
condition (57) becomes 

(0.5 + Ai)(l + A 2 )(l + A 3 ) > c, 



1 



74 sec (7r/4) z 



1.06. 



(58) 



Condition ( 58 ) relates the compartmental coupling to the synchronization property of the com- 
partments through the algebraic connectivities A&, k = 1,2,3. For simplicity, we assume that 
those edges that exist all have the same weight q (which can be interpreted as diffusion coeffi- 
cients), i.e. a* ■ € {0, q} for every k = 1, 2, 3, i, j = 1, 2, . . . , n. 

Consider for example the case in which only the first and the second species diffuse. Then 
condition ( 58 ) reduces to 

(0.5 + Ai)(l + A 2 ) > c. (59) 

By substituting the expression for the algebraic connectivity (for different graph topologies) in 
the second order inequality (59) we can find conditions on the number of cells and the diffusion 
coefficients such that synchronization is guaranteed. In Table [7] we list these conditions for a 
number of relevant graph topologies. 



The resulting relations admit interesting biological interpretations. Let us think of each 
compartment as a biochemical network inside each cell in a population or "colony" of n identical 
cells. 

Consider the complete graph denoted as G c in Table [7} Now pick a diffusivity coefficient q 
for which our "synchronization condition" estimates fail to hold, and suppose that the overall 
network does not synchronize. From Table [7j we observe that a sufficient increase in the total 
number of cells in the colony will result in synchronization between all the cells. Thus, we may 
view the number of cells as an order parameter (or "synchronization bifurcation" parameter). 
Numerical simulations substantiate this claim, as shown in Figure [7j 
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Graph 



G c (Complete) 




G s (Star) 




G r (Ring) 



Gi (Line) 



Ai 



nq 



nq 



4 g sin 2 (^) 



4 g sin 2 (^) 



2«[l-co6(i; 



2g[l-co6(£)] 



4gsin 2 (^) 



2g[l-cos(£) 



Synchronization condition 



n > 



c- 0.5 



71 > 



-3 + y/9 + 8c 
4g 



g > c- 0.5 



9 > 



-3 + V9 + 8c 



q > 



n < 



c-0.5 



/ c-0.5 \ 
\/—) 



q > 



n < 



-3 + V9 + 8c 
16 



-3+V9+8c 



16(j 



q > 



n < 



c-0.5 



( c-0.5 
\ 2q 



+ 1 



q > 



71 < 



V9 + 8c - 3 



Table 1: Sufficient conditions, obtained from (59), to achieve synchronization for different dif- 



fusive graph topologies. For each graph depicted in the first column, we consider two cases: (1) 
only the first species in each compartment are allowed to "diffuse", and (2) both the first and 
second species "diffuse" . 
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Figure 6: Simulation results for a network of Goodwin oscillators where only the first species 
are coupled through a complete compartmental coupling G c and where q = 3 • 10~ 3 . On the 
left: two oscillators are not sufficient for synchronization. On the right: simulation results for 
180 oscillators. As predicted by the synchronization condition the oscillators synchronize 

As another example, consider the star graph G s . Analyzing the conditions in Table [7j we 
see that, for this type of graph, the number of cells does not play a role in the conditions for 
synchronization. Instead, it is only required now that q be beyond a given threshold. 

The ring graph G r and the line graph G\ lead to a quite different qualitative picture. First, 
note that we obtain two separate conditions for q and n. If q is sufficiently large (e.g., in the 
case of first and second species coupled, q > 0.074 for G r and q > 0.148 for Gi), then we have 
an upper bound on the number of cells, instead of a lower bound. Thus, for either line or ring 
topologies, in which the graph diameter increases with the number of cells, we see that a large 
number of cells, n, leads to more restrictive conditions for synchronization. In Figure [7j this 
phenomenon is illustrated through simulations. Indeed, numerous bounds have been derived in 
the literature |23| |24"] which show that, as the diameter is increased to infinity, the algebraic 
connectivity of a graph tends to zero. 
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Figure 7: Simulation results for a network of Goodwin oscillators where only the first species are 
coupled through a ring compartmental coupling G r and where q = 0.15. On the left: as predicted 
by the synchronization condition four oscillators are sufficient for the network to synchronize. 
On the right: the number of cells is increased up to 45 and synchronization is not observed. 



7.1 Synchronization conditions and observer design 

To illustrate the idea introduced in Remark 2, we consider two Goodwin oscillators and a 
directed link coupling the first species. This special interconnection structure gives rise the 
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G (Goodwin Oscillator) 




Figure 8: System-observer interpretation for two Goodwin oscillators unidirectionally coupled 



following system-observer dynamics: 

x\ 

yi 



G 



-0.5xi - 2/4 

-0.5x2 + 0.5xi 

-0.5x 3 + 0.5x 2 
1 



4 + 1 



G 



XI 

x 2 

m 



-0.5 xi — ?/4 + q(x\ — xi) 

-0.5x2 + 0.5xi 

-0.5x 3 + 0.5x 2 
1 



xf + 1 



The term g(xi — xi) (where q is the weight of the link), that was interpreted as diffusion of the 
first species concentrations, is now the output injection to the observer G (see Figure pi). Then 



the synchronization condition (58) reduces to 

0.5 + 2 g > c, 



1.06, 



(60) 



and can be interpreted as a sufficient condition for the observer error to converge to zero. We 
conclude that if 



q > 



0.5 



then the errors Xk — x& — > as t — > oo, k 



2 

1,2,3. 
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8 Conclusion and future work 



Synchronization properties for networks of nonlinear systems have been investigated combin- 
ing the input-output properties of the subsystems with the information about the structure of 
network. The proposed model is motivated by cellular networks where signaling occurs both in- 
ternally, through interactions of species, and externally, through intercellular signaling. Results 
for state-space models as well as biochemical applications have been derived as corollaries of the 
main result. The extension of the present work to diffusion models (by using partial differential 
operators) is currently being developed by the authors. 
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